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REMARKS 

Appellant has resubmitted the appealed claims (see revised Appellate 
Brief attached). Appellant notes that she has amended claims 1 and 18 to 
include all of the features of dependent claims 16 and 33, respectively. 

Accordingly, Appellant requests entry of these claim amendments 
because the amendments: (a) place the application in condition for allowance; 

(b) do not raise any new issues regarding further search and/or consideration; 

(c) do not present any additional claims without canceling the corresponding 
number of finally rejected claims; and (d) place the application in better form 
for appeal, if an appeal is necessary. 

Here, each of elements (a) -(d) is satisfied. Appellant took features from a 
dependent claim and placed them into independent form. No new search is 
required by such an amendment. No new issues are raised and the claims are 
in better condition for allowance. 

Accordingly, Appellant respectfully requests that the members of the 
Board and/or to Examiner enter the amendments contained in Appellant's 
revised Appellate Brief dated October 21, 2005. 

Should there be any outstanding matters that need to be resolved in the 
present application, the Examiner is respectfully requested to contact John E. 
Curtin at the telephone number of the undersigned below. 
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In the event this Response does not place the present application in 
condition for allowance, Appellant requests the Examiner to contact the 
undersigned at (703) 668-8000 to schedule a personal interview. 

If necessary, the Commissioner is hereby authorized in this, concurrent, 
and future replies, to charge payment or credit any overpayment to Deposit 
Account No. 08-0750 for any additional fees required under 37 C.F.R. § 1.16 or 
under 37 C.F.R. § 1.17; particularly, extension of time fees. 



Respectfully submitted, 



HARNESS, DICKEY, & PIERCE, P.L.C. 



By 



John/E. fcurtin, Reg. No. 37,602 
P.o/Box8910 
Refiton/ Virginia 20195 
(703) 668-8000 




JEC:ame 
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SECOND, REVISED BRIEF ON BEHALF OF APPELLANT 

In support of the Notice of Appeal filed February 1, 2005, appealing the Final Rejection 
mailed January 6, 2005, Appellant hereby provides the following remarks. 
L REAL PARTY IN INTEREST 

The present application is assigned to Lucent Technologies Inc., by an Assignment 
recorded on June 1, 2001, Reel 011853, Frame 0222. 

II. RELATED APPEALS AND INTERFERENCES 

The Appellant does not know of any appeals or interferences which would directly affect 
or which would be directly affected by, or have a bearing on, the Board's decision in this Appeal. 

III. STATUS OF THE CLAIMS 

Claims 1-34 are pending in the application, with claims 1 and 18 being written in 
independent form. 

Claims 1-34 remain finally rejected under 35 U.S.C. §§ 112 and 102 are being appealed. 

IV. STATUS OF ANY AMENDMENTS FILED SUBSEQUENT TO THE FINAL 
REJECTION 

A Request for Reconsideration ("Request") dated February 1, 2005 was filed with the 
U.S. Patent and Trademark Office in response to the Final Rejection. On June 20, 2005, 
Appellant received a fax copy of an Advisory Action dated February 24, 2005 which considered 
but did not enter claim amendments contained in the Request. Subsequently, the Examiner twice 
objected to Appellant's Appeal Brief. This second, revised appeal brief is submitted on response 
to the Examiner's most recent objection dated September 22, 2005. 

In this latest appeal brief Appellant has amended claims 1 and 18 to include all of the 
features of claims 16 and 33, respectively. 
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V. SUMMARY OF THE CLAIMED SUBJECT MATTER 

This invention relates to a method for network-based speech recognition of subscriber (or 
"user") voice-commands for invoking call information and management features and text-to- 
speech translation of call information and call management features. 

Real-time systems with telephony interfaces, including telephony and computer systems, 
offer a large variety of useful network-based features, such as Caller-ID, conferencing (call 
merge), call forwarding, call hold and messaging. However, these features must generally be 
accessed with some difficulty in a real-time interactive environment. Often, users cannot 
effectively access certain features, at Least in part because such access requires knowledge of 
subject-specific details with which the user may be unfamiliar. Although the user can learn some 
subset of the features set and use them effectively with cues and practice, if the user does not 
need to use a particular system for some time, it is likely that his or her ability to use the system 
and understand the features will diminish. Users may also be unable to access certain features 
because the access device has a limited set of features, such as a small display on a cell phone 
handset. (See Specification, page 1.) 

While in operation, a system can be in one of many different 'states" at which services or 
features at-c available. An example of such a system state is a state in which a Call arrives and a 
caller-ID is to be displayed. The system transitions from a Call in Progress" state to a "Caller ID 
on Call Waiting" state at which point the subscriber has several options. Another example is 
when a subscriber calls someone and the called line rings busy. The system enters a state of 
"Busy' for at caller and an option is available to have the network 5 feature continually re-try 
(redial) the called party until there is a "Ringing" system state. When the called party picks up, 
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another system state is entered. If the called party does not answer after a predefined number of 
rings, then the system state changes to a "Ring-No-Answer" state and other features are available 
to the caller at this latter state, such as "Leave a Message", "Continue Trying the Number for 24 
hours", etc. 

A call flow is a pathway of steps that a call follows from the time that the call is initiated 
until termination of the call. Each step in the call flow may also be considered a different system 
state. The call flow may be controlled by the user to the extent that the user determines whether 
to initiate some calls, stay on the line, select features, answer a call, or subscribe to messaging 
services. Other types of system states include states wherein the caller communicates with the 
system or causes the system to communicate with another system, such as another network. (See 
Specification, pages 2-3.) 

To remind users of features available at a particular point in a call flow or some other 
system state, specialized equipment is often used to display which features are available in the 
current state of a call or communication transaction. Computer and telephony systems, for 
example, require that users learn to interface with the systems using specialized devices, such as 
keypads, keyboards, mice, and trackballs, and special or reserved procedures which may appear 
in the form of an interaction on a computer screen or in a voice response system. Another 
limitation on feature accessibility is that the telephone keypad, keyboard, and mouse do not 
provide wide bandwidth for input to a system. In a real-time transaction environment, this 
constraint reduces the number of sophisticated features that may be made available in a 
telephony session or transaction dialog. 
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Some feature sets attempt to offer simplified interfaces by utilizing visual cues and 
mnemonic devices. An enhanced version of the Caller-ID feature, Caller-ID on Call Waiting, 
represents one attempt to provide a simplified interface with visual cues. Ordinary Caller-ID is 
provided using specialized equipment, such as an adjunct display device or a telephone with an 
integral display and special protocols. Currently available Caller-ID class 2 services, such as 
Caller-ID on Call Waiting, however, require more specialized equipment, such as an Analog 
Display Service Interface (ADSI) screen phone. There is an automated communication sequence 
between the service provider switch and the premise equipment that allows a user who receives 
Caller-ID information or originating system to utilize that information to make decisions as to 
how to handle ("manage") the incoming call based on the Caller-ID or originating station 
information. For example, using one feature call flow, when a person is already on the phone 
and another call comes in, the person already on the phone will know who is calling from the 
displayed Caller-ID information and can decide from a displayed menu whether to play a 
message and put the person on hold, conference the call with the current call, drop the current 
call and take the new call, send the call to voice mail, forward the call, or take other actions. But 
if one has only an ordinary non-ADSI phone, these actions must currently be entered using Star 
Features, such as *82 which are difficult to remember. (See Specification, pages 3-4.) 

The specialized ADSI device displays in text form a full list of options which can be 
used to respond to the Caller-ID information. The subscriber can then select a desired option 
using the keypad which generates a DTMF (dual tone multi-frequency) signal understood by the 
service provider switch, or using soft keys on the ADSI screen phone which correspond to 
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functional options displayed to the called party. Caller-ID information is displayed on a screen 
in either case. 

The specialized ADSI equipment is expensive and its functionality is only available at the 
location of that phone. When a subscriber uses a different phone, he or she cannot access these 
features. Even in one household, only those extensions with the specialized phones will be able 
to use the enhanced feature set. Moreover, subscribers who are visually impaired may not be 
able to use the display devices at all. 

There accordingly exists a need for network-based speech recognition. It would also be 
particularly helpful to combine the network-based speech recognition with a network-based text- 
to-speech translator of call state or progress information and available call management features. 
This would enable network service providers to offer a wide variety of features to mobile 
phone/web users by "translating" features available on a network to an audio format 
recognizable to the device upon which the audio is to be played, such as a sound or wave file, to 
which a user could respond with a voice command upon which speech recognition is performed. 
(The device-specific audio capabilities may be referred to as the device's audio form factor.) 
(See Specification, page 5.) 

The present invention provides an automated speech recognition method and system such 
as Verbal Information Verification or the like that has the flexibility to utilize a more extensive 
grammar than in a system recognizing only globally-available commands without having to train 
the system to recognize the particular subscriber's pronunciations of words. In the inventive 
speech recognition method, a subscriber causes the performance of an action available on a 
communications network using a spoken utterance, which essentially operates as a voice 
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command to activate a control sequence at the network. The type of action performed includes 
the accessing of a feature of a feature complex available on the network, such for example as call 
forwarding, hold, conferencing, voice-mail, call back, and caller-ID features, and a spoken menu 
of available features. In order to be recognized, the spoken utterance must be one that is 
permissible at a particular state, such as at a point in the call flow, in which the utterance is 
recited. After recognizing the spoken utterance, the utterance is converted to electronically- 
readable data having a format recognizable by the network or network application element. The 
control of features of the automated speech recognition method and system with spoken 
utterances may be supplemented with the inputting by a subscriber of key inputs that control 
features in combination with the spoken utterances. 

To recognize the spoken utterance, a system state database is maintained either at a 
network level or at a point between the network and the subscriber's handset or headset or other 
type of subscriber device. The system state database has a plurality of nodes, each respective 
node representing a particular state of a plurality of possible system states. The possible system 
states may comprise the available steps in a call flow as well as other system states. Associated 
with each node in the system state database is a predetermined grammar that is available at the 
system state represented by that node. The grammar may be stored in a database separate from 
the system state database or in the system state database itself The grammar available includes 
one or more "reserved words' that are descriptive of the action to be performed, and may further 
include synonyms of the one or more words, and globally-available words that are available at all 
of the plurality of nodes. The grammar for each node may be available for multiple languages. 
Because the system limits the number of words that may be accessed at any particular system 
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state, the system need only compare the spoken utterance to a limited number of words available 
for that system state and hence has a simplified speech recognition task. (See Specification, 
pages 6-7.) 

Additionally, the system may comprise a translation platform, such as a text-to-speech 
translator, of system features to audio form factors of communication devices that interact with 
the network to permit other network-generated signals, such as a signal in an ADSI or DTMF 
format, to be translated from an electronically-readable format to an audible message. The 
translator functionality can be used to provide a spoken menu of choices available to a subscriber 
at a given system state. The text-to-speech translator may provide audio using any means 
including a recorded announcement or synthesized announcement of menu choices that may be 
played to a subscriber. The text-to-speech functionality, or recording of announcement can also 
be used to inform the user about the "state" of a call, or what node of the system state database is 
activated. (See Specification, page 7.) 

Referring initially to FIGs. 1 and 2A (Appendix B), in a prior art telephone network 15 
premise devices 30, 50, 70 are connected to an interexchange carrier (IXC (long distance 
carrier)) 10 via one or more local exchange carriers (LEC's), also referred to as central offices. 
Premise devices 30, 50, 70 are shown as connected to network 15 via distinct respective central 
offices 20, 40, 60. The premise devices 30, 50, 70, such as telephones or other communication 
devices, such as a computer, television modified for communication, other wired or wireless 
devices, etc, connect to system node 100, such as a central office / IP (internet protocol) which 
performs typical central office functions, or to any access management complex/service feature 
platform in communication with the network that provides access to the central office. A call 
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may be transferred between two central offices or from a central office to an IXC. There are 
services and features associated with each local and long distance transmission, network, and 
carrier. 

A subscriber may listen at and speak directly into one of the premise devices or may use 
a headset (not shown) for these purposes. One function performed at system node 100 is to track 
the call flow or "state" of each call using inband signaling so that the network maintains updated 
status information such as the setup of telephone calls between premise devices, who is on the 
phone with whom, when calls are placed on hold, terminated or forwarded, etc. Referring to 
FIG. 3 A (Appendix C), node 100 may also have various components, including a feature 
complex 100b that provides a class of features available to premise devices connected to the 
network via node 100 (including billing name and address, features available to the subscriber, 
etc.), a subscriber database 100a with subscriber information for node 100, a cache / local 
memorylOOc, and other components lOOd that perform additional central office functions. (See, 
Specification, page 12.) 

The present invention enhances network functionality by adding to network 15 a 
networked speech processing unit 200 (FIG. 2B; Appendix B) connected to node 100 and 
universally accessible to any network-based feature available at that node. Each central office 
requires its own speech processing unit 200 or connectivity to a speech processing unit. (The 
speech processing unit may also be referred to as a translation platform because it translates an 
utterance to a command recognizable by the system and can translate system data to an available 
audio format (form factor) at the audio-enabled device (e.g. telephone.)) Speech processing unit 
200 provides a networked voice interface to node 100, over inband path 120 through network or 
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common interfaces lOOe, 200a. (FIG. 3B; Appendix D) Signaling or network commands 
corresponding to a feature or function can be downloaded to the memory of the communication 
device for future use/access with voice, etc. Stored features can be scrolled and selected by the 
user. (See Specification, page 13.) 

The speech processing unit 200 should be bridged to the network so as to be able to listen 
at all times after a user session (such as a call) is initiated with the network (and possibly another 
caller) for a user's voice commands. To this end, speech processing unit 200 may be 
permanently connected to the network and the speech recognition functionality is made available 
to the network once the user session is initiated. Where the speech processing functionality is 
only available to a user who subscribes to a speech accessible service, then the connectivity is 
available to subscribing users only. The speech recognition may be turned off during a session. 

Speech processing unit 200 includes a Text-to-Speech ("TTS") application, such as the 
TTS application described in U.S. Patent No. 4,899,358 entitled Call Announcement 
Arrangement which is hereby incorporated by reference as if fully set forth herein. The TTS 
application enables the network to read textual messages containing system information, 
including call information, aloud to a subscriber, even in the absence of a user interface like a 
voice, visual, or multimedia prompt. These textual messages that are generated on network 10 in 
a format such as ADSI (which usually requires a special phone for display) and provide call 
information, (such as Caller-ID information), are sent to the TTS application at speech 
processing unit 200 where they are converted to spoken messages and transmitted inband back 
through central office 100 to the subscriber who can hear the messages without any specially 
equipped phone. The TTS application comprises a TTS engine 200d that controls the text to 
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speech translation, acoustic files 200Z? containing the sounds for pronouncing the words of text, 
TTS databases 200h that define the correspondence of text to speech, and a memory cache 200c 
in which to temporarily store a received text message for translation. (See Specification, 
pages 13-14.) 

Speech processing unit 200 further includes an Utterance Verification / Verbal 
Information Verification ("VIV") application. See, e.g. U.S. Patent No. 5,649,057 entitled 
'Speech Recognition Employing Key Word Modeling and Non-Key Word Modeling" and U.S. 
Patent No. 5,797,123 entitled "Method of Key-Phase Detection and Verification for Flexible 
Speech Understanding", which are hereby incorporated by reference as if fully set forth herein. 
The VIV application enables the network to interpret spoken utterances of the subscriber, 
particularly those spoken utterances which are commands to the network to provide call 
information or information about available call management options, or to invoke call 
management or application features. The VIV application has a VIV engine 200e to perform the 
speech recognition, and reference databases 200/, for correlating the detected subscriber 
utterances, interpreting them and translating them into a format that is recognizable by the 
network element or application. 

Algorithm databases 200g in speech processing unit 200 contain one or more algorithms 
that the system may use for speech recognition. There is at least one algorithm database 200g for 
each system state represented by a node in the system state database 210, described below. Each 
of the algorithm databases 200g contains the grammar elements associated with that node and a 
cross reference to a network element or application command for each grammar element. 
Additional algorithms per node may also be supplied to provide different levels of speech 
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recognition, for example, as where a first algorithm performs a less sophisticated, relatively 
quick speech recognition technique while a second algorithm performs a more sophisticated 
speech recognition technique which is used if the first algorithm is unsuccessful in recognizing 
the speech. Different models may also be used for speech recognition of males and females, 
children, people from different countries or regions, etc, who may pronounce grammar in a 
particular language differently. 

A platform services database 200/ in speech processing unit 200 contains signaling 
commands, etc. to correspond with features and services available at the speech processing 
unit/translation platform 200. (See Specification, pages 14-15.) 

As stated above, a "call flow" is the series of steps that a call follows from the time it is 
initiated until the call is terminated. Each such step represents a "state" that the system is in at 
that point during the call's progress. At certain steps, there are multiple alternatives from which 
a subscriber can choose. For example, a subscriber might put a call on hold or conference that 
call into another call. The number of different paths that a subscriber can specify at any 
particular point in the call flow is finite. A spoken utterance, which is essentially a voice 
command, can specify the path that is to be followed at a point in the call flow. A system state 
database 210 that may be resident at speech processing unit 200 or elsewhere in the system can 
specify a unique grammar or "reserved words" that a subscriber may utter at each system state to 
serve as the voice command to select a desired feature available at that state, such as a call 
management function. Only that predetermined grammar will be accepted as input to invoke a 
call management feature appropriate to the particular state, such as the particular stage of the call 
flow. A reserved word need not be an actual word but may instead be a mnemonic. 
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A system state database 210 generally has the tree-shaped structure shown in FIG. 4 
(Appendix E). In one example of a system state database 210, node A\ may represent a 

subscriber engaged in an existing call. There are M possible states, represented by nodes Bt-BM, 
to which the call may proceed from node Ai. Nodes Ai and nodes Bi-Bm store grammar 
appropriate to a particular state to activate the different features available to a subscriber at each 
respective node at central office 100 or call management complex for managing the call. For 
example, node Bi may represent a new, additional incoming call to the subscriber and available 
respective subscriber commands to invoke features appropriate to node Bi. For example, a 
subscriber may say a word at Bi that is descriptive of the action that the subscriber wishes to be 
performed, such as saying the word "Menu" to obtain a spoken menu of the available features 
which may be selected. Alternatively, a subscriber may say "Conference" to conference the new 
call into the existing call, "Hold" to place the new caller on hold, "Voice Mail" to send the new 
caller into voice mail, "Take Call" to connect the subscriber to the new incoming call and to 
place the existing call on hold, "Will Call Back" to bookmark the Caller-ID for a list of calls to 
be returned, "Caller-ID" or more simply "Who's Calling?" to have the network read the caller 
identification information for the new caller. The "reserved words" themselves are defined in 
VIV reference database 200/. The database also includes within each of the respective nodes 
synonyms of the reserved words for the respective node. For example, instead of "Menu" the 
subscriber may say "List" or "Features", instead of "Conference" the subscriber may say 
"Bridge", ".loin", or "Merge", instead of "Hold" the subscriber may say "Wait", and instead of 
"Voice Mail" the subscriber may say "Message", "Announcement" or "Play Message". 
Additionally, the respective nodes may include globally-available commands, such as "help", 
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"repeat", "back", and "select language". These globally-available commands may be saved at a 
respective node or may be stored elsewhere and made available as an option at each node. 
Branching from nodes Bi...Bm are additional respective nodes Ci-Cn at which grammar, 
including synonyms, usually for later system states are stored. For example, where a subscriber 
gives the command to "conference" the call at node Bt, the subscriber may thereafter invoke the 
"hold" or "transfer" command at node Ci which is a node that branches from node Bi. Other 
nodes Q...Cn may branch from node Bj for alternative call flows. (See Specification, pages 15- 
17.) 

It should be understood that a particular call flow or group of related system states may 
have a state at which there is a change of system state from a system state represented by a lower 
node in database 210 to a higher system state (e.g. a move from node B] to node A). It should 
also be understood that the system state database 210 may, depending on the system state, be 
entered at any node, including any branch or leaf of a tree-shaped database structure, rather than 
only at the top node A. 

Node B2 represents a different state than node Bi, such as a state in which the subscriber 
has received an incoming call from the second caller while on the line with the first caller but the 
second caller has hung up. If a subscriber utters an incorrect utterance that is not within an 
acceptable grammar for the respective step in the call flow at which the utterance is spoken, the 
system might not respond at all, or can indicate to the subscriber that the utterance is not 
recognized. 

The system may also allow for utterances in more than one language by providing 
multiple system state databases 210, one per language, each of the databases 210 having 
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appropriate grammar for the language of that database. For example, the subscriber may utter a 
reserved word to access a call management feature and the system will recognize not only 
whether the word is acceptable grammar for that context but also the language of that word. 
Thereafter, the network will switch to the system state database 210 for the recognized language 
and interact with that subscriber in the language of the uttered reserved word. Uttering the 
reserved words in another language will, on the other hand, redirect the call to another system 
state database for the recognized language, or the system state database 210 may incorporate 
foreign reserved words in appropriate nodes for recognition without the need for separate 
databases. However, incorporating too many reserved words at a particular node may impact the 
ability to perform speech recognition of relatively reduced complexity. In addition to 
interpreting subscriber utterances in the selected language, the language of the subscriber 
utterance may be used by the TTS application to read the utterance to the subscriber in the same 
language. If there is any ambiguity as to what the subscriber has said (i.e., ambiguity as to the 
utterance, which may also be referred to as an "acoustic input"), this can be handled by the VIV 
application at speech processing unit 200 using well-known algorithms such as Hidden Markov 
Models, word spotting or word combinations, and user interface techniques (such as prompt for 
confirmation or requiring a combination of utterances, key presses, etc. as input to the system). 
The functionality of the speech recognition may be enhanced by the use of a subscription-type 
service wherein a given subscriber provides a voice model of the subscriber's voice that is used 
by speech processing unit 200. (See Specification, pages 17-19.) 

Some communication devices that may communicate with the network and S sample 
profiles of those "target" devices include the devices and sample profiles shown in FIG. 5A 
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(Appendix F): earbud 220, mobile phone 222, wireless appliance 224, personal computer 226, 
personal digital assistant 228, telematics 230 for a vehicle which may have features like a 
telephone, email and sensors like air bag, engine, vital signs, and other passenger sensors to 
communicate with a central office when there is a problem, an entertainment center 232 having 
communication functions, an appliance 234 like a microwave oven, oven or refrigerator, that has 
communications functionality like email functions, and a Residential Gateway 236 (shown in 
more detail in FIG. 14; Appendix V) having features such as cardiac, blood pressure, sugar and 
scale monitors of a person at a location of interest. In exchanging messages with these devices, 
it is of course necessary to send a message packets in the device formats. 

The profile of a device is sent by the particular device to the network when the device 
shakes hands with the network at session setup. The Bluetooth protocol is one protocol in which 
profiles are exchanged between devices and between a device and the network. Thus, the 
network knows the device protocol when the network sends inband signals to the device. Where 
multiple types of devices communicate with a particular network 15, system state databases may 
also include profile databases that contain profiles for communication devices which 
communicate in voice and/or data with the network 15 such as devices to which commands are 
transmitted. The target communication device profiles are defined and stored in a database look 
up table (LUT) at speech processing unit 200, such as the database LUT 240 shown in FIG. 5B 
(Appendix G), which also specifies the format from the available translation formats for 
translating features from a data format to the appropriate audio form factor and vice versa. For 
example, the profile for earbudi shows that earbudi has a speaker and microphone and uses a 
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Form 1 translation format, which is a format suitable for this device. (See Specification, 
pages 19-20.) 

Some of the various possible call flows and other system states which can be handled by 
the present invention are now discussed. FIG. 6A (Appendix I) depicts one example of the steps 
for a subscriber to change system states. At step 260, the network is in a state where it is 
"Always on" and the phone is "on-hook" (for a phone) or "connected but not in use" for some 
other device. In this state, various actions may occur. For example, subscriber S may receive 
information that an information provider pushes to his terminal (e.g. advertisements) possibly 
without ringing the phone (e.g. suppressed ring function), or may lift up the phone or activate 
another device, or access network messages, data, or information. In the illustrated example, 
subscriber S speaks a globally available word to get the system's attention at step 265. The 
network (or network enhancement comprising the speech recognition and text-to-speech 
functionality) listens for a command and, in this example, subscriber S says "Place call" (step 
270). (Rather than initiating a call, subscriber S may just initiate a communication with the 
network at step 270, which would send the messages, etc.) At step 275, the network recognizes 
the utterance and translates the utterance to a network feature command. The command is 
translated to feature complex 100b or to a service complex (step 280), which causes the network 
state to change to "Initiate call" mode (step 285). (See Specification, page 20.) 

Rather than simply allowing a subscriber to begin entering voice commands, a subscriber 
may have to invoke a specific command at a particular system state that indicates to the system 
that the words that follow are instructions to the system and not a conversation among 
subscribers. For example, the subscriber may have to say the word "Computer" or some 
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uncommon word that will not generally be used in a conversation in order to access the menus, 
in response, a noise, such as a chirping noise, may then be played to indicate that voice 
commands can be now be entered. This access restriction prevents the subscriber from 
accidentally triggering the voice command system while engaged in a conversation and expands 
the amount of grammar that can be used at a particular node. 

Once a call is initiated, an example of a suitable "Request Menu" call flow during which 
a subscriber can ask to receive a spoken menu of the available choices at a point in the call flow 
is shown in FIG. 6B (Appendix J). At the start of the call flow (step 300), a call between 
subscriber S using telephone 30 and caller 1 using telephone 50 is in progress (FIG. 1). At step 
310, caller 2 at telephone 70 calls subscriber S and subscriber S then hears a "call waiting" tone 
at telephone 30 generated by the network central office 100 (step 320). The "call waiting" tone 
may be a unique tone that indicates to the subscriber the feature that he or she can interact with. 
The tone may also suppress the voice channel to other callers so that the tone is not heard by 
others. (See Specification, page 21.) 

At step 330, the network central office "listens" to determine whether or if subscriber S 
presses plunger (also known as a switch hook) on telephone 30 or enters a DTMF input on a 
keypad of telephone 30. At the same time, speech processing unit 200 listens on inband path 120 
for subscriber S to recite any node-appropriate reserved words, as an alternative to listening for 
plunger or DTMF input. Depending on a user-selectable setting, the voice channel to caller 1 
either remains suppressed after the call waiting tone to listen for any reserved words, or 
subscriber S must first place caller 1 on hold to deal with the incoming call and can then utter an 
appropriate reserved word. At this step 330, the reserved words listed in a system state database 
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210 will be a word or words that provide subscriber S with an audio menu of grammar 
appropriate to that point in the call flow. At step 340, subscriber S utters a reserved word such as 
"Menu". Speech processing unit 200 uses word spotting and utterance verification with VIV to 
recognize the "Menu" command from subscriber S, first referencing system state database 210 to 
check whether the voice command is an allowed context-specific word (step 350). Speech 
processing unit 200 notifies central office 100 that the "Menu" function was selected (step 360). 
In response, central office 100 transmits a textual list of appropriate menu items, which are the 
features made available by feature complex 100b, to speech processing unit 200 (step 370). The 
TTS application processes the received text and plays audio to subscriber S, via central office 
100, as a spoken menu that is read aloud to advise subscriber S of the available features from 
which subscriber S may now select (step 380). As indicated above, some typical call 
management features available at central office 100 include "Conference" (caller 2 conferenced 
into existing call), "Hold" (places caller 2 on hold), "Voice Mail" or "Play Message" (sends 
caller 2 into voice mail), "Take Call" (connects subscriber S to caller 2 and places caller 1 on 
hold), and "Caller-ID" (reads the caller identification information to subscriber S). (See 
Specification, pages 21-22.) 

The menu of available features at that node may also be displayed on a display, if 
available either when the spoken menu is requested or earlier at a point when the call flow is 
directed to that node. Because of the relatively small size of a display on telephone 30 or a 
mobile terminal 820 that cannot display all menu options at once, the options are displayed 
generally in an abbreviated or abridged fashion (e.g. only certain commands or using acronyms 
or other abbreviations), as shown in FIG. 5C (Appendix H). (The spoken menu may be heard for 
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example at mobile terminal handset 820 or earbud 840.) The benefits of visually seeing even an 
abbreviated menu include allowing a subscriber to determine one or more menu choices if he 
missed or could not comprehend a choice in the spoken menu and serving as another reminder of 
the available options. (See Specification, pages 22-23.) 

The "Request Menu" call flow leads into the "Select from Menu" call flow shown in 
FIG. 6C (Appendix K). Subscriber S selects an available feature from the recited menu (step 
400) by reciting an appropriate reserved word or words, which may include words to activate a 
node-specific or globally available feature. At step 410, speech processing unit 200 looks in the 
system state database 210 and compares the recited words to the list of context-appropriate 
grammar to determine if the recited words are allowed. If the words do not appear at the 
appropriate node in the database, subscriber S is notified that the selection is an inappropriate 
selection (step 420) and is returned to step 400 or, alternatively, subscriber S may be permitted to 
return to step 340 (not shown) to request that the menu be read again. If subscriber S says 
grammar again and the recited grammar is unrecognized a second time at step 410, the algorithm 
proceeds to step 422 where subscriber S can try to utter proper grammar again or may enter a 
selection on a keypad. For example, subscriber S may be presented with a spoken menu that 
says "Press or say 1 for Hold, 2 for Conference, 3 for Voice Mail. If the subscriber utterance is 
recognized at step 422 or the subscriber presses an appropriate key, then the proper item is 
selected in speech processing unit 200 (step 424) and the algorithm proceeds to step 430. If the 
subscriber utterance is not recognized, then the subscriber may be given some other alternative at 
step 426. If the words recited by subscriber S are recognized as reserved words (including 
globally available words) at steps 410 or 422 or an appropriate key is pressed, then the call flow 



Page 19 



Serial No. 09/764,708 
Atty. Ref. 29250-002049/US 

continues to step 430 where signal processing unit 200 notifies the network as to which feature 
was selected. If the 'Take Call" feature is selected (as determined at step 440), the network puts 
caller 1 on hold and caller 2 is connected to subscriber S (step 450). If the "Take Call" feature is 
not selected, then network 100 invokes the selected feature (step 460) and reconnects subscriber 
to caller 1 (step 470). When a voice prompt is being played, as at steps 340 or 380, subscriber S 
may just "barge in" and recite a reserved word to invoke a desired feature immediately if there is 
an echo canceler in the network 100. (See Specification, pages 23-24.) 

A particular node in system state database 210 may represent the function of exiting a 
routine or terminating a call. A list of available words for this function would be included in a 
grammar for that node. The available words at that node may include, for example, "hang- 
up'V'end call", "terminate", "good-bye", "go away", "scram", and "exit". 

FIG. 7 (Appendix L) depicts a flow chart of an alternative to the combined Request Menu 
and Select from Menu call flows. This "Select from Menu, No Prompt" call flow offers 
subscriber S the alternative of selecting a feature for processing an incoming call from caller 2 
without prompting the subscriber with the available menu selections, thereby avoiding steps 340- 
380. In this alternative call flow, subscriber S and caller 1 are engaged in a call (step 500) when 
caller 2 calls subscriber S (step 510). Subscriber S hears a call waiting tone (step 520). At step 
530, the network central office "listens" to determine whether subscriber S has depressed the 
plunger on telephone 30 or entered a DTMF input using a keypad of telephone 30. Speech 
processing unit 200 also "listens" on inband path 120 and waits a predetermined number of 
seconds for subscriber S to recite any reserved words. At step 540, subscriber S may select an 
available feature, which he or she knows to be available, by reciting a reserved word. The call 
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flow determines at step 550 whether the recited words are valid reserved words in system state 
database 210 for invoking an available feature, whether a node-specific feature or a globally- 
available service or feature. If the recited words are not recognized as reserved words or if the 
subscriber says nothing and the timeout period ends, subscriber S is prompted to access the help 
menu and, if the subscriber responds affirmatively after a prompt, he is offered the help menu at 
step 560. If subscriber S says grammar again and it is unrecognized a second time at step 550, 
the algorithm proceeds to step 562 where subscriber S can try to utter proper grammar again or 
may enter a selection on a keypad. For example, subscriber S may be presented with a spoken 
menu that says "Press or say 1 for Feature 1, 2 for Feature 2, 3 for Feature 2. If the subscriber 
utterance is recognized at step 562 or the subscriber presses an appropriate key, then the proper 
item is selected in speech processing unit 200 (step 564) and the algorithm proceeds to step 570. 
If the subscriber utterance is not recognized, then the subscriber may be given some other 
alternative at step 566. If the recited reserved words are recognized as valid at step 550 or step 
562 or an appropriate key pressed, then signal processing unit 200 processes the acoustic signal 
at step 570, using word spotting and utterance verification with VIV to recognize the recited 
words, and notifies the network as to which feature has been selected. If the "Take Call" feature 
is selected, as determined at step 580, the network puts caller 1 on hold and caller 2 is connected 
to subscriber S (step 590). If the "Take Call" feature is not selected, then the network invokes 
the selected feature (step 600) and reconnects subscriber S to caller 1 (step 610). (See 
Specification, pages 24-25.) 

The "Select Language" call flow (FIG. 8A; Appendix M) described above permits the 
automated selection of the language in which subscriber S converses with the network. At step 
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640, the present system state of the network is identified at a node "x" which triggers a particular 
operation associated with the node. The "Select Language" call flow can be invoked, for 
example, in the "Request Menu" call flow before step 320 or in the "Select from Menu, No 
Prompt" call flow before step 520. At step 650, subscriber S hears a tone generated by the 
network that is appropriate to the particular state of the system or call, such as a tone indicating 
that there is a call waiting, or instead of hearing a tone the subscriber just recognizes the system 
state, and speaks an appropriate command. Subscriber S must respond within a predetermined 
number of seconds. At step 651 (which is optional), the system may determine a particular type 
of recognition model to use to identify and/or recognize the spoken command using the 
algorithm described below with respect to FIG. 8B (Appendix N). If step 651 is performed, the 
system thereafter proceeds to step 690. If step 651 is not performed, the system proceeds to step 
669 where the grammar spoken by subscriber S is identified at the appropriate node on system 
state database 210 as belonging to a particular language by referencing database 210. Thereafter, 
the speech processing unit 200 operates in the identified language for both input and output by 
branching to appropriate grammar / language functions at step 670, such as English 680a, 
Spanish 68Gb, Italian 680c, French 680d, etc. Thereafter, the grammar at state "x" is recognized 
(step 690), the word(s) represented by the grammar is recognized (step 700), the feature 
represented by the recognized word(s) activated (step 710) and the call state is changed or 
updated (step 720). (See Specification, page 26.) 

Males, females, children, and people from different backgrounds, parts of a country, 
ethnicity, etc. pronounce words differently. It is advantageous to create various speech 
recognition models with separate templates for each group of people. These templates can then 



Page 22 



Serial No. 09/764,708 
Atty. Ref. 29250-002049/US 

be used to determine whether a subscriber belongs to a particular group of persons and, if such a 
determination can be made, the comparison in FIG. 8B between a spoken utterance and grammar 
at a node of a system state database can be simplified. Rather than having to compare the spoken 
utterance to a template comprising multiple pronunciations of a reserved word for all types of 
people, the comparison can be limited to pronunciations only for one type (e.g. compare to male 
pronunciations in the template when the subscriber is a male). This simplification also is 
advantageous in that it allows a larger set of grammar to be used because the fewer comparisons 
that need to be made for speech recognition, the less possibility for confusing the recognition of 
a particular word. 

FIG. 8B is a flow chart illustrating the steps, according to one embodiment, for 
determining what recognition model to use at optional step 651 of FIG. 8 A. At step 652, the 
system checks whether the subscriber II) is a known caller-E) or station ID (e.g. a subscriber's 
phone number) by searching a caller record database 666, an example of which is shown in 
FIG. 8C. If the subscriber ID is known, then at step 653 the record for that subscriber is 
retrieved, if any new subscriber information is provided. Database 666 may provide various 
types of caller information for that caller, such as caller record, voice template, preferred 
language of that caller, password, etc. For example, a first record in database 666 shown in 
FIG. 8C is for caller ID (732) 555-1111. This First record is assigned customer ID number 0231, 
uses voice template "File 0231", has a password/key of "turtle", the preferred language for that 
subscriber is English, and the subscription information indicates that this subscriber uses remote 
access. The information in database 666 may be compiled by any provisioning method, such as 
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by requiring a user to enter user profile and preference information and a means of updating the 
database should be provided. (See Specification, pages 27-28.) 

At step 654, a subscriber-specific, language-specific grammar database, which correlates 
the subscriber's utterances to particular commands, is accessed to attempt to recognize the 
spoken grammar using a language-specific grammar database. If the grammar is recognized as 
appropriate for the current system state, the system at step 655 returns to step 690 of FIG. 8B. If 
the grammar is not recognized at step 654, at step 656 an alternate method of treatment 
(grammar recognition) may be attempted. If the alternate treatment accomplishes grammar 
recognition, the system proceeds to step 690 of FIG. 8B. Otherwise, the subscriber should be 
requested to repeat the spoken utterance. 

If the subscriber ID is not known at step 654, at step 657 the system checks whether the 
voice pattern of the subscriber correlates with predefined male, female or child attributes that are 
defined in available templates. If the voice pattern does correspond, then the appropriate male, 
female or child speech recognition template 658, 659, 660, respectively, is selected and the 
system proceeds at step 661 to the node corresponding to the system state in the system state 
database 210 to check whether a reserved word has been uttered. If possible, the language of the 
utterance is determined at step 662 (in a manner equivalent to steps 670 and 680 of FIG. 8A). If 
the language cannot be determined at step 662, at step 664, grammar for all languages and 
templates is compared to the spoken utterance. If the spoken utterance is now recognized, the 
system proceeds to step 655 which returns the system to step 690 of FIG. 8A. Otherwise, an 
alternate treatment to attempt speech recognition is attempted at step 665. If the language of the 
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spoken utterance is recognized at step 662, a language-specific grammar is compared to the 
spoken utterance at step 654. (See Specification, page 28.) 

Referring to FIG. 9 (Appendix P), the speech processing system of the present invention 
may be similarly interfaced with a mobile cellular network 800. Call flows akin to those 
described above may be used with networks 800, including any type of network or the Internet, 
to communicate with a mix of devices including devices 810 such as ordinary telephones and PC 
computer terminals having a wired connection to the network, mobile devices/terminals 820 that 
interface with the network over a mobile telephone switching office (MTSO) 821 (which is the 
equivalent of the central office in the mobile universe), and specialized devices 830 such as 
ADSI phones. Network 800 includes a service platform 802 and a speech translator 804 between 
which signals 806 pass. In lieu of placing speech translator 804 directly on the service platform 
802, translator 804 may be located outside of service platform 802 but otherwise linked thereto. 
Mobile device 820 comprises a mobile phone handset 822 or a personal digital assistant (PDA) 
228 such as a Palm Computing device, that has an antenna 823, keypad 824, CPU 825, display 
826, speaker 827, and microphone 828. Device 830 is shown as a telephone with built-in ADSI 
support, a display 834, a keypad 836, a speaker 837, a microphone 838, and an optional TTS 
engine 839. 

A subscriber may use mobile terminal 820 with a headset 840 such as a wired 20 headset 
to be plugged into a jack (not shown) on handset 822 or a wireless headset such as the earbud 
headset shown in FIG. 10A (Appendix Q). Wireless headset 840 communicates with handset 
822 over a short range communications link 839, such as a Bluetooth link. FIG. 10B 
(Appendix Q) depicts the relevant components of headset 840. More particularly, headset 840 
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comprises a microphone 841 for communicating with other subscribers and entering voice 
commands, a speaker 842 to enable a. subscriber to listen to other subscribers and to text menus 
of commands that are translated to speech, a digital signal processor 843, an A/D converter 844 
to convert voice commands to a text-based signal, compression/decompression functionality 845, 
data transfer functionality using antenna 846, Bluetooth RF-in 847, and Bluetooth RF-out 848 to 
send signals to other external devices like handset 822 or personal digital assistant 228 to 
generate a tone for transmission to network 800, a memory 849, a profile of the headset 
capabilities 850 stored in memory 849, activation buttons 852 such as a plunger to signal the 
handset 822, an audio generator 854, a DTMF generator 855, automatic speech recognition 
(ASR) capabilities 8S6 (whether implemented in hardware or software), a TTS engine 857, 
grammar rules 858., and a power supply 860. (See Specification, pages 29-30.) 

Microphone 841 allows a subscriber to speak into headset 840 and to thereby 
communicate voice commands to the network 800. In a first scenario, the voice command may 
be output from Bluetooth RF-out 848 of headset 840 as a voice payload and transmitted via a 
baseband layer of the Bluetooth link to the input of another Bluetooth-enabled device such as 
handset 822 or PC terminal 810 where a system state database 210 is located (database 210 may 
of course be located elsewhere where it is accessible such as at speech processing unit 200) and 
is referenced to convert the voice command to a network-recognizable signal such as an ADSI 
command. The database 210 and LUT 240 alternatively may be located at the headset 840, 
MTSO 821, or at speech processing unit 200. In a second scenario, the voice command may be 
interpreted by a speech recognition component 8S6 (or by a separate VIV or UV application) 
that may be installed in headset 840, which seeks the command in a look-up table installed 
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locally at headset 840. The LUT 240 at headset 840 outputs the appropriate signal through the 
handset 822 which is then converted by LUT 240 to an ADSI signal before a message is 
delivered to the service platform. The translation table may be on board the consumer device, or 
accessed on the network. In a third scenario nearly identical to the second scenario, the LUT at 
headset 840 outputs the appropriate signal as a DTMF signal rather than as an ADSI signal. In a 
fourth scenario, instead of a subscriber speaking a command into microphone 841, the network 
800 generates a voice prompt in speaker 842 and, in response, the subscriber depresses button 
852 to generate an output back to the network 800. This output may be in any of various formats 
including a voice response, text, ADSI, DTMF or other type of signal based on the profile. (See 
Specification, pages 30-31.) 

Examples of call flows for a mobile network 800 where a signal originating at a service 
platform 802 is transmitted by the network 800, is translated at some point from text to speech, 
and is audible at headset 840 or at handset 822 (with text) if there is no headset 840 connected, 
are depicted in FIGs. 11A-11D. In the call flow of FIG. 11A (Appendix R), at step 900 service 
platform 802 has a message for a subscriber. Network 800 issues a signal to the MTSO platform 
821 for forwarding to the subscriber to determine if the subscriber is available. The signal is 
forwarded from MTSO platform 821 to handset 822 (step 902), and is in turn transmitted from 
handset 822 to headset 840 over the Bluetooth link 839 to determine whether the subscriber is 
available (step 904). If the subscriber acknowledges that he or she is available by causing an 
ACK signal to be sent from headset 840 to handset 822 and includes a profile of the capabilities 
of headset 840 (step 906) (as in a Bluetooth-enabled headset), handset 822 sends an ACK signal 
to MTSO 821 (step 908) and a "request message" command is transmitted from MTSO 821 to 
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service platform 802 (step 910) to request whatever message service platform 802 has to convey 
to the subscriber. The message sent over network 15 is then translated by speech processing unit 
200 and is formed into a payload. The payload is then sent by the service platform 802 (step 
912) to MTSO 821 which arranges for speech processing unit 200 to translate a portion of the 
payload into text for display on handset 822 according to the capabilities of the handset (e.g., text 
may be abbreviated for a limited size handset display). MTSO 821 then transmits the text 
message to handset 822 (step 914). TTS engine 819 at handset 822 translates the text message to 
audio and relays the audio message from handset 822 to headset 840 where it is played to the 
subscriber (step 916). The illustrated message played to the subscriber may, for example, be 
"Call from 732-123-4S67". (See Specification, page 31.) 

Another possible call flow is shown in FIG. 11B (Appendix R). In this instance, at step 
920 service platform 802 has a message for a subscriber. Network 800 issues a signal to the 
MTSO platform 821 for forwarding to the subscriber to determine if the subscriber is available. 
The signal is forwarded from MTSO platform 821 to handset 822 (step 922), and is in turn 
transmitted from handset 822 to headset 840 over the Bluetooth link 839 to determine whether 
the subscriber is available (step 924). If the subscriber acknowledges that he is available by 
sending an ACK signal to handset 822 and includes a profile of the capabilities of headset 840 
(step 926), handset 822 sends an ACK signal to MTSO 821 (step 928) and a "request message" 
command is transmitted from MTSO 821 to service platform 802 (step 930). The message 
payload is then sent by the service platform 802 (step 932) to MTSO 821. In this call flow, there 
is no translator at MTSO 821 to convert the message payload so the payload is forwarded 
without translation to handset 822 (step 934). The message payload is translated to text at 
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handset at 820 (step 936), and the text is transmitted to headset 840 where a ITS engine 857 
converts the text to speech that is played at headset 840 (step 938). 

In a third call flow shown in FIG. 1 1C (Appendix S), at step 940 service platform 802 has 
a message for a subscriber. Network 800 issues a signal to the MTSO 821 for forwarding to the 
subscriber to determine if the subscriber is available. MTSO 821 transmits the signal to the 
subscriber's handset 822 (step 942). The handset 822 responds to MTSO 821 with a profile of 
the handset's capabilities and identifies the on-board TTS engine 819 (step 944), and a "request 
message" command is transmitted from MTSO 821 to service platform 802 (step 946). The 
message payload is then sent by the service platform 802 (step 948) to MTSO 821. MTSO 821 
translates the message payload to a text message and transmits the text message to handset 822 
possibly in a compressed format (step 950). TTS engine 819 at handset 822 translates or 
reconnects the text message to audio and plays the decompressed message (step 952). (See 
Specification, pages 32-33.) 

In a fourth call flow shown in FIG. 11D (Appendix S), at step 960 service platform 802 
has a message for a subscriber. Network 800 issues a signal to the MTSO 821 for forwarding to 
the subscriber to determine if the subscriber is available (step 960). MTSO 821 transmits the 
signal to the subscriber's handset 822 (step 962). The handset 822 responds to MTSO 821 with a 
profile of the handset's capabilities, which in this case does not include a TTS engine (step 964), 
and a 'request message" command is transmitted from MTSO 821 to service platform 802 (step 
966). The message payload is then sent by the service platform 802 (step 968) to MTSO 821. 
Because in the example of FIG. 11D there is no TTS engine at handset 822, MTSO 821, which 
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in this case has its own TTS engine, translates the message payload to an audio message for 
playback at handset 840 and transmits the audio message as a payload to handset 822 (step 970). 

In a fifth call flow, shown in FIG. 12 (Appendix T), an "open channel" connection from 
service platform 802 to speech processing unit 200 "listens" for messages, including but not 
limited to (i) signaling messages for translatable features, services and applications, (ii) speech 
messages that comprise grammar associated with nodes on a call flow or key words used to 
activate features, and (iii) messages containing translated instructions, commands, etc. that 
originate at mobile terminals 820 or earbud 840. 

FIG. 13 (Appendix U) illustrates an example of a call flow for a text-to-speech 
conversion (i.e. translation) of text originating at service platform 802 to speech which can be 
heard by the subscriber at headset 840 where a dialogue is already in progress. At step 1200, a 
signal message is sent to a subscriber device 821' such as a telephone, PC, set top box, or an 
Access Point as described below, that an ADSI message is to be sent. The subscriber device 
821' responds with an acknowledgement of the signal and a profile of itself, which reveals that it 
is not an ADSI phone (step 1210). The text-to-speech conversion engine accessed by the service 
platform 802 is accessed and the text message is sent there for conversion from ADSI format to 
speech (step 1220). The converted speech is received back at service platform 802 and is sent to 
the subscriber via subscriber device 821' (step 1230), which then relays it to an optional handset 
822 (step 1240), and in turn to headset 840 (step 1210) (or directly to headset 840 from 
subscriber device 821' where there is no interposed handset 822 as at a PC interface or a 
residential gateway). The speech may take the form of a menu of available features, such as the 
spoken message: "Features available are Hold, Conference, Send to Voice Mail". In response, 
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the subscriber issues a command, such as the "Conference" command (step 1260), and an 
automatic speech recognition function is performed at headset 840 where a system state database 
210 is used to recognize the command and convert the command to text (step 1270). The 
converted text is then relayed to subscriber device 821' (step 1280). Alternatively, instead of 
performing step 1270 at headset 840, the functions of step 1270 may be performed at handset 
822. The text is transmitted from subscriber device 821' to service platform 802 (step 1290) 
where the text is inserted into a lookup table application and translated to an ADSI command for 
recognition by service platform 802 (step 1300). The speech recognition function can be 
performed through an open voice path between the microphone 828 and the speech processing 
unit (translation platform) 200. (See Specification, pages 33-35.) 

While the above description describes examples of the implementation of the invention 
over wired and cellular networks, the invention is more broadly applicable to all types of 
networks, including in addition satellite and cable networks 1400, as depicted in FIG. 14 
(Appendix V) which also shows an access point 1410 into a location 1420 such as a home or 
office, for communications delivered in various ways, including by coaxial cable, fiber optics, 
copper wires, wireless, satellite, or microwave service, for any of the various types of networks. 
The access point 1410 may itself be any access point such as a residential gateway, a "bump" or 
"hole" in the wall, like a wireless LANport, (like Airport, Wave LAN, Orinoco, etc.) that 
provides a link to access for wireless or wired devices for voice, data, etc. within a home, office, 
or other site using a wireless protocol such as 3G (Third Generation Wireless Format), UMTS 
(Universal Mobile Telecommunications System), Bluetooth, etc. 
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It should be understood that an automatic speech recognition method and system having a 
system state database in accordance with the present invention may be used for communicating 
with a communication system in other system states presented by other types of features, such 
for example as call blocking features wherein the subscriber can provide instructions to the 
network defining the times during which calls should be blocked or specific numbers that should 
be blocked. A voice menu having appropriate grammar choices can be deployed to allow a 
subscriber to provide such instructions. Although numbers may be easily input with a key input 
such as a numeric keypad, other aspects of provisioning the service features are thereby 
simplified using speech. Speech recognition can also be used to identify ambiguous utterances. 
For example, rather than only accepting utterances, the system may also permit entry of key 
input entries: "Press or say 1 for Hold, 2 for Conference, 3 for send to Voice mail". Moreover, 
speech processing unit 200 may be directly connected to the service platform or may be resident 
elsewhere while coupled to the network. For example, all or a portion of the speech processing 
unit may be alternatively located at one of the Internet, a computer, a mobile phone, a headset, a 
handset, a base station, a set-top box, a personal digital assistant, an appliance, and a remote 
control. (See Specification, pages 35-36.) 

It should be further understood that the inventive automatic speech recognition method 
and system that recognizes spoken utterances may be implemented as an option that can be 
selectively toggled on and off. For example, the default condition may be to leave the system on. 
In addition, the system can permit the user to request a mnemonic device during a call. 
Connections to the system can be by subscription by access through a service platform or by 
other means. 
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While there have shown and described and pointed out fundamental novel features of the 
invention as applied to preferred embodiments thereof, it will be understood that various 
omissions and substitutions and changes in the form and details of the methods described and 
devices illustrated, and in their operation, may be made by those skilled in the art without 
departing from the spirit of the invention. For example, it is expressly intended that all 
combinations of those elements and/or method steps which perform substantially the same 
function in substantially the same way to achieve the same results are within the scope of the 
invention. Moreover, it should be recognized that structures and/or elements and/or method 
steps shown and/or described in connection with any disclosed form or embodiment of the 
invention may be incorporated in any other disclosed or described or suggested form or 
embodiment as a general matter of design choice. (See Specification, pages 36-37.) 

Appellant respectfully notes that the above summary of the invention, including any 
indication of reference numerals, drawings, figures, paragraphs, page numbers, etc. (collectively 
referred to as "descriptions" of the application) have been provided solely to comply with the 
U.S. Patent and Trademark Office's rules concerning the appeal of the claims of the present 
application. As such, the descriptions above are merely exemplary and should not be construed 
to limit the claims of the present application in any way whatsoever. 
VI. ISSUES TO BE REVIEWED ON APPEAL 

(i) Whether claim 3 is unpatentable based on 35 U.S.C. §112, second paragraph? 

(ii) Whether claims 1-34 are anticipated by U.S. Patent No. 5,566,229 to Hou et al. 
("Hou")? 
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VIL ARGUMENTS 
The Section 112 Rejections 

Appellant has amended claim 3 (see Appendix A). Claim 3 was rejected under 35 U.S.C. 
§112, second paragraph, the Examiner stating that the phrase "the feature complex" was unclear. 
Appellant believes the amendment of claim 3 satisfies and overcomes the Examiner's rejection. 
This amendment has been made to clarify the text of claim 3 and is unrelated to issues regarding 
the patentability of claim 3. 

Accordingly, Appellant respectfully requests that the Board grant allowance of claim 3. 

The Section 102 Rejections 

Claims 1-34 were rejected under 35 U.S.C. § 102(b) as being anticipated by Hou. 
Appellant respectfully disagrees and traverses this rejection for at least the following 
reasons. 

Initially, Appellant notes that claims 1 and 18 have been amended (see Appendix A) to 
point out that the system state database includes "a plurality of system states, each state 
comprising a plurality of possible steps in a call flow." These features were taken from claims 
16 and 33, respectively. Appellant respectfully submits that these changes place the claims in 
condition for allowance. 

Hou does not disclose or suggest such a system state database. 

The reference database 50 disclosed in Hou is used to store speech records of so-called 
"call labels," not steps in a call flow, as in the claims of the present invention. More specifically, 
Hou's stored speech records appear to represent destinations of a subscriber's call, e.g. "call 
office" (see column 10, lines 14-15). 
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Because Hou does not disclose each and every feature of the present invention, Hou 
cannot anticipate the claims of the present invention. 

Accordingly, Appellant respectfully requests that the Board reverse the decision of the 
Examiner and grant allowance of claims 1-34. 

IX. CONCLUSION 

Accordingly, for at least the aforementioned reasons, Appellant respectfully requests that 
the Honorable Members of the Board of Patent Appeals and Interferences reverse each of the 
outstanding rejections in connection with the present application and allow each of the pending 
claims in connection with the present application. 

If necessary, the Commissioner is hereby authorized in this, concurrent, and future 
replies, to charge payment or credit any overpayment to Deposit Account No.08-0750 for any 
additional fees required under 37 C.RR. § 1.16 or under 37 C.F.R. § 1.17; particularly, extension 
of time fees. 



Respectfully submitted, 



HARNESS, DICKEY, & PIERCE, P.L.C. 



JEC:psy 



By: 
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APPENDIX A 

1. (Currently Amended) A method for permitting a subscriber to perform an action 
available on a communications network using a spoken utterance, comprising: 

maintaining a system state database comprising a tree structure having a plurality of 
nodes, each respective node of said plurality of nodes representing a particular system static eaH- 
flow step of a plurality of possible system states, each state comprising a plurality of possible 
steps in a call flow, including an "always connected" state in which a feature may be accessed 
even when a call is not in progress steps in a call flow and being associated with a predetermined 
note-specific grammar for the respective node; 

awaiting from the subscriber a spoken utterance at the particular call flow step; 

recognizing the spoken utterance by comparing the spoken utterance to the predetermined 
grammar for the respective node for correspondence to the particular call flow step; and 

performing an action at the network represented by the spoken utterance if the spoken 
utterance has been recognized as the predetermined grammar for the respective node, wherein 
the action activates a control sequence at the network for accessing a feature available on the 
network. 

2. (Original) The method of claim 1, further comprising, after recognizing the 
spoken utterance, converting the spoken utterance to electronically-readable data having a format 
recognizable by one of the network, and transmitting the converted data to the respective one of 
the network. 

3. (Previously Presented) The method of claim 1, wherein the spoken 
utterance comprises a command to access one of a plurality of available features on the network 
and a spoken menu of the available features. 

4. (Original) The method of claim 3, wherein the feature comprises one of a 
group consisting of call forwarding, hold, conferencing, voice-mail, call back, caller-ID, caller- 
ID related features and caller-ID related functions. 
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5. (Original) The method of claim 1, wherein the node-specific grammar 
associated with each respective node comprises at least one of a group consisting of a word 
descriptive of the action to be performed, a synonym of the word, and a globally-available word 
available at all of said plural nodes. 

6. (Original) The method of claim 1, wherein the predetermined grammar for 
the particular node comprises grammar for multiple languages. 

7. (Original) The method of claim 6, wherein the spoken utterance of the 
subscriber is in one of the multiple languages, and the method further comprises the steps of: 

determining the one of the multiple languages of the spoken utterance of the subscriber; 

and 

communicating via the network with the subscriber via a text-to-speech translator that 
translates in the determined one language of the subscriber. 

8. (Original) The method of claim 1, further comprising determining a particular 
template to use for speech recognition from a plurality of predefined voice pattern templates, 
wherein the particular template comprises a subset of the predetermined grammar for the 
respective node, and wherein the step of recognizing the spoken utterance comprises comparing 
the spoken utterance to the predetermine subset of the predetermined grammar for the respective 
node. 

9. (Original) The method of claim 8, wherein the plurality of predefined voice 
pattern templates comprises independent templates for males, females, and children. 

10. (Original) The method of claim 1, further comprising the step of prompting 
the subscriber to issue the spoken utterance using one of a group consisting of a spoken menu 
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generated by a text to speech translator, a recorded announcement of a menu, and a synthesized 
announcement of the menu. 

1 1 . (Original) The method of claim 1 , further comprising the steps of: 
transmitting, by the network, a signal to the subscriber in a data format not audibly recognizable 
by the subscriber; and converting the transmitted signal to an audible message recognizable to 
the subscriber using one of a text to speech translator, a recording of speech, and a speech 
synthesizer. 

12. (Original) The method of claim 11, wherein the signal transmitted by the 
network to the subscriber comprises one of the group consisting of an ADSI signal and a DTMF 
signal. 

13. (Original) The method of claim 1, wherein the action performed comprises 
transmitting, by the network, of a signal to a second network. 

14. (Original) The method of claim 1, wherein the method is performed by a 
speech recognition system, and the method further comprises the step of providing to the 
subscriber an ability to operatively toggle on and off the speech recognition system. 

15. (Original) The method of claim 1, wherein the system state database is 
located on a speech processing unit coupled to the network through one of the group consisting a 
local communications office equipment, the Internet, a computer, a mobile phone, a headset, a 
handset, a base station, a set-top box, a personal digital assistant, an appliance, and a remote 
control, and wherein said step of comparing the spoken utterance is performed at the location of 
the system state database. 

16. (Cancelled) 
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17. (Original) The method of claim 1, further comprising: inputting a key input, 
and wherein the step of performing the action comprises performing the action in accordance 
with the spoken utterance and the key input. 

18. (Previously Presented) A communications system providing speech 
recognition functionality to a network, comprising: 

a device coupled to the network and into which an utterance may be spoken by a user, 
a system state database accessible to the network and defining a tree structure having a 
plurality of nodes, each respective node of said plural nodes representing a particular^ call flow 
step of a plurality of possible call flow steps system states, each state comprising a plurality of 
possible steps in a call flow, including an "always connected" state in which a feature may be 
accessed even when a call is not in progress and being associated with a predetermined node- 
specific grammar for the respective node; 

means for interpreting the user-spoken utterance; 

means for comparing the interpreted spoken utterance to the predetermined grammar for 
the respective node corresponding to the particular call flow step to recognize the spoken 
utterance as corresponding to the predetermined grammar associated with the respective node; 
and 

means for performing an action represented by the spoken utterance at the network if the 
spoken utterance has been recognized as corresponding to the predetermined grammar associated 
with the respective node, wherein the action activates a control sequence at the network for 
accessing a feature available on the network. 

19. (Original) The communications system of claim 18, wherein the spoken 
utterance comprises one of a group consisting of a command to access a feature available at the 
network, and a spoken menu of available features at the network. 

20. (Original) The communications system of claim 18, wherein the spoken 
utterance comprises a command to access a feature available at the network, the feature 
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comprising one of a group consisting of call forwarding, hold, conferencing, voice-mail, call 
back, and caller-ID. 

21. (Original) The communications system of claim 18, wherein said interpreting 
means comprises an utterance verification engine. 

22. (Original) The communication system of claim 18, wherein said comparing 
means comprises a reference database which comprises the predetermined node-specific 
grammar associated with each respective node. 

23. (Original) The communications system of claim 22, wherein the system state 
and reference databases are both maintained on a speech processing unit coupled to the network 
through one of a group consisting of a local communications office equipment, the Internet, a 
computer, a mobile phone, a headset, a handset, a base station, a set-top box, a personal digital 
assistant, an appliance, and a remote control. 

24. (Original) The communications system of claim 22, wherein the node- 
specific grammar associated with each respective node comprises at least one of a group 
consisting of a word that is descriptive of the action to be performed, a synonym of said at least 
one word, and a globally-available word available at all of said plural nodes. 

25. (Original) The communications system of claim 18, wherein the 
predetermined grammar for the particular node comprises grammar for multiple languages. 

26. (Original) The communications system of claim 25, further comprising 
means for determining the language of the spoken utterance of the user, and a text-to-speech 
translator for translating communications from a network to the user in the determined language 
of the user. 
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27. (Original) The communications system of claim 18, further comprising 
means for offering the user a spoken menu of the predetermined grammar available at the 
respective node in the call flow. 

28. (Original) The communications system of claim 27, further comprising 
means for receiving the requested spoken menu and at least a partial text menu of the available 
features. 

29. (Original) The communications system of claim 18, further comprising 
means for transmitting, to the user, a signal in a data format not audibly recognizable by the user, 
a text to speech translator, and means for converting the transmitted signal to an audible message 
recognizable to the user using the text to speech translator. 

30. (Original) The communications system of claim 29, wherein the transmitted 
signal comprises one of a group consisting of an ADSI signal and a DTMF signal. 

31. (Original) The communications system of claim 18, wherein the means for 
performing an action comprises means for transmitting a signal transmitted between networks. 

32. (Original) The communications system of claim 18, further comprising 
means for toggling on and off the speech recognition and text-to-speech functionality. 

33. (Cancelled) 

34. (Original) The communications system of claim 18, further comprising: 
means for inputting a key input, and wherein the means for performing the action 

comprises performing the action in accordance with the spoken utterance and the key input. 
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